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CONSTANT  ACCESS  SYSTEMS: 

A  GENERAL  FRAMEWORK  FOR  GREEDY 

OPTIMIZATION  ON  STOCHASTIC  NETWORKS 


by 
Michael  Page  Bailey 

Department  of  Operations  Research 

U.  S.  Naval  Postgraduate  School 

Monterey,  California 


ABSTRACT 

We  consider  network  optimization  problems  in  which  the  weights  of  the  edges  are  random  variables.  We 
develop  conditions  on  the  combinatorial  structure  of  the  problem  which  guarantee  that  the  objective  function  value  is 
a  first  passage  time  in  an  appropriately  constructed  Markov  process.  The  arc  weights  must  be  exponentially 
distributed,  the  method  of  solution  of  the  deterministic  problem  must  be  greedy  in  a  general  sense,  and  the 
accumulation  of  objective  function  value  during  the  greedy  procedure  must  occur  at  a  constant  rate.  We  call  these 
structures  constant  access  systems  after  the  third  property.  Examples  of  constant  access  systems  include  the  shortest 
path  system,  the  longest  path  system,  time  until  disconnection  in  a  network  of  failing  components,  and  some 
bottleneck  optimization  problems.  For  each  system,  we  give  the  distribution  of  the  objective  function,  the 
distribution  of  the  solution  of  the  problem,  and  the  probability  that  a  given  arc  is  a  member  of  the  optimal  solution. 
We  also  provide  easily  implementable  formulae  for  the  moments  of  these  quantities. 


1.0      INTRODUCTION 

In  this  paper,  we  unify  a  set  of  results  concerning  the  performance  of  networks  with  random  arc  weights. 
Finding  the  distributions  of  the  shortest  path,  longest  path,  and  maximum  flow  were  provided  in  Kulkarni[1987], 
Kulkarni  and  Adlakha[1986],  and  Kulkarni  [1987],  where  each  problem  was  considered  on  a  network  with 
independent,  exponentially  distributed  arc  weights.  In  each  case,  a  Markov  process  was  constructed  for  which  the 
first  passage  time  to  a  set  of  states  was  the  optimal  objective  function  value  of  the  problem.  Thus,  the  distribution, 
moments,  etc.,  of  the  optimal  objective  function  value  could  be  found  using  standard  Markov  process  technique. 

The  same  methodology  was  applied  to  the  nonplanar  maximum  flow  problem  and  to  Prim's  spanning  tree 
problem,  neither  attempt  being  successful.  We  could  not  construct  a  Markov  process  with  first  passage  time  equal 
to  the  objective  function  value  for  either  problem,  though  these  problems  seem  closely  related  to  the  problems  for 
which  the  method  was  successful.  This  left  the  investigators  with  the  problem  of  determining  which  characteristics 
of  these  optimization  problems  was  essential  in  order  to  ensure  that  a  Markov  process  solution  exists. 

This  paper  provides  a  general  framework  for  randomly  weighted  network  optimization  problems  which  have 
optimal  objective  function  values  are  given  by  absorption  times  of  some  Markov  process.  The  restrictions  which 
describe  this  class  are  that  the  method  of  solution  is  essentially  greedy,  and  that  the  underlying  combinatorial 
structure  have  two  properties  which  we  call  the  constant  access  and  interval  properties.  For  any  combinatorial 
optimization  problem  with  these  properties,  we  give  the  construction  of  the  Markov  process  required.  For  each 
system,  we  give  the  distribution  of  the  objective  function,  the  distribution  of  the  solution  of  the  problem,  and  the 
probability  that  a  given  arc  is  a  member  of  the  optimal  solution.  We  also  provide  easily  implementable  formulae 
for  the  moments  of  these  quantities.  All  of  these  calculations  exploit  the  uppertriangularity  of  the  generator  matrix 
jf  the  constructed  Markov  process. 

Awareness  of  a  general  class  of  constant  access  systems  allows  us  to  consider  other  combinatorial  optimization 
Oroblems  and  to  determine  if  they  may  be  extended  to  the  randomly  weighted  case  using  Markov  processes.  By 
binpointing  the  required  properties  for  successful  application  of  Markov  processes  to  the  objective  function 
distribution  problem,  we  can  narrow  the  search  for  problems  for  which  we  expect  success.  Stated  differently,  we 
jtave  shown  that  the  mechanism  of  transition  in  Markov  processes  is  identical  to  the  mechanism  of  access  of  the 
ijreedy  algorithm. 


Let  E  be  a  set  of  elements,  typically  the  edges  of  a  graph,  and  let  B  be  a  set  of  strings  made  up  of  elements  in 
E.  For  each  Ye  B,  let  W(Y)  be  a  random  variable  corresponding  to  the  objective  function  value  of  Y.  We  are 
interested  in  computing 

F(Y,  t)  =  P[W(Y)  <  t,  W(Y)  <  W(Y')  for  all  Y'  e  B], 

the  probability  that  Y  is  the  minimum  weight  element  of  B  and  its  value  does  not  exceed  t.  The  marginals  of  F 
may  be  used  to  find  the  distribution  of  the  optimal  objective  function  value,  criticality  indices  for  each  arc,  and  other 
interesting  network  performance  measures.  In  Dijkstra's  shortest  path  algorithm  (forward  looking  version),  B  is  the 
set  of  states  which  have  the  destination  permanently  labeled  If  Y  is  one  such  state,  F(Y,  t)  is  the  probability  that  Y 
is  the  terminating  state  of  the  algorithm  and  the  shortest  path  has  length  not  exceeding  t.  If  we  aggregate  all  of  the 
states  which  give  the  same  shortest  path,  we  can  sum  the  probabilities  to  find  the  probability  that  a  given  path  is 
shortest  and  its  length  does  not  exceed  t,  and  we  can  let  t  — » «>  to  find  the  probability  that  a  given  path  is  shortest. 

In  this  work,  we  will  identify  a  class  of  problems  for  which  a  stochastic  process  (X(t),  t  >  0}  may  be 
constructed  such  that  each  Ye  B  is  an  absorbing  state  of  (X(t),  t  >  0).  The  fundamental  property  of  (X(t)}  is 
that  F(Y,  t)  is  the  distribution  of  the  time  of  {X(t)]'s  first  passage  to  Y.  Characteristics  of  this  class  of 
combinatorial  problems  include  optimality  of  the  greedy  algorithm  for  the  underlying  deterministic  combinatorial 
problem,  as  well  as  two  properties  called  the  interval  and  constant  access  properties.  The  stochastic  process 
(X(t),  t  >  0}  is  shown  to  be  a  generalized  semi-Markov  process  (GSMP).  When  the  arc  weights  are  exponentially 
distributed  and  independent,  (X(t),  t  >  0}  is  a  Markov  process. 

In  Section  2  we  outline  the  combinatorial  structures  which  we  will  treat.  Section  3  contains  the  combinatorial 
results  required  to  pursue  the  case  of  random  weights.  Section  4  contains  the  analysis  of  stochastic  combinatorial 
problems,  including  the  conditions  under  which  the  stochastic  system  is  a  Markov  process.  We  use  the  Markov 
process  to  derive  distributions  of  interest  and  we  include  some  results  on  computational  efficiency.  In  Section  5  we 
detail  some  important  examples  of  constant  access  systems.  While  some  of  these  systems  have  been  investigated  ad 
hoc  in  [1987],  [1986],  and  [1987],  several  of  these  systems  are  new  to  the  literature.  They  were  uncovered  as 
constant  access  systems  as  a  result  of  the  construction  of  the  general  system.  Section  6  contains  our  conclusions 
and  some  comments  concerning  extensions  of  this  work. 


2.0      BASIC    COMBINATORICS 

In  this  section,  we  establish  the  terminology  and  notation  necessary  to  describe  the  systems  we  study.  We 
define  the  minimizing  greedy  algorithm  and  give  Dijkstra's  shortest  path  system  as  an  example. 

Let  E  be  a  set  which  we  refer  to  as  the  ground  set,  and  let  £  be  a  set  of  simple  strings  (ordered  sets  with  no 
repeats)  of  elements  in  E.  Let  X  e  £-,  then  the  i-th  element  in  the  suing  X  is  denoted  xj,  and  the  length  of  the 
suing  is  given  by   I  X  I .    We  will  denote  the  operation  of  concatenation  as  "•".    Thus  if  X  =  (x     x2,  ...,  x,), 

a  6  E,  and  Y  =  (yr  y2,  ...,  ym),  then  Xa  =   (xr  x2 xk,  a),  and  X  Y  =  (x,,  x2 xk,  yr  y2,...,  yj. 

For  the  string  X  =  (x,,x2,...,xk),  the  string  made  up  of  the  first  i  elements,  i  <  k,  will  be  denoted  X, 
X.  =  (Xj,  x,,...  ,X:),  and  is  called  a  prefix  of  X.  We  will  use  set  operations  n,  u,  C,  and  e  on  the  strings  of  £  to 

indicate  the  operation  performed  on  the  underlying  set  of  the  string. 

In  this  work,  we  will  deal  with  string  systems  have  the  following  properties: 

i)     <M  & 

ii)    X  e  C  implies  that  Y  e  C  for  all  Y  C  X. 

The  set  £  is  called  the  set  of  feasible  strings. 

We  often  wish  to  refer  to  the  set  of  elements  of  E  which  we  can  feasibly  append  to  the  suing  X  e  £,  denoted  as 
A(X).  This  set  is  called  the  set  of  accessible  elements  of  X  and  is  formally  given  by  A(X)  = 
{x  e  E:  Xx  e  Q.  When  an  element  of  A(X)  is  appended  to  X,  it  is  said  to  have  been  accessed.  The  set  B  is 
defined  as  B  =  {X  e  £:  A(X)  =  0},  and  is  called  the  set  of  basic  strings,  following  the  terminology  used  in  matroid 

theory.  An  access  chain  to  X  e  £,  |  X  I  =  k,  is  the  sequence  of  feasible  strings  X0  =  $,  X  ,  X2 Xk  =  X.  Note 

that  for  any  X  €  £,  |  X  I  =  k,  {Y  €  B:_X  is  on  a  chain  of  access  to  Y}  =  {Ye  B:  Yk  =  \}. 

2.1    Clutter   Intersection    Systems 

Let  v:E  — >  9l+  be  a  nonnegative  weight  function  on  the  set  E.  For  each  Y  e  B,  define  d  (Y)  to  be  a  known 
subset  of  {Y}  called  the  determining  structure  of  Y.    Let  w  be  the  objective  function  on  B  given  by 

wOO  =  Ixed*(Y)  v(x), 

thus,  each  basic  element's  weight  is  linear  in  its  determining  structure.  Note  that  if  d  (Y)  equals  the  underlying  set 
of  Y,  then  w  is  the  linear  objective  function  common  to  matroid  analysis. 

In  our  development,  we  will  make  the  following  two  assumptions  concerning  determining  structures  of  basic 
elements: 


0     UY6Bd*(Y)  =  E 

ii)    d*(Y)£  d*(Z)forany  Y.Ze  B,  Y  *  z. 

Thus  the  set  {d  (Y):  Ye  B}  is  a  clutter  on  the  set  E,  see  Edmonds  and  Fulkerson  [1970].  Assumption  i 
guarantees  that  every  member  of  E  belongs  to  at  least  one  determining  structure.  Assumption  ii  guarantees  that  for 
each  determining  structure  of  a  basic  element,  there  exists  a  weight  function  for  which  that  determining  structure  is 
of  minimum  weight.  In  a  two  terminal  undirected  network  in  which  each  arc  is  on  a  path  between  the  terminals,  the 
set  of  paths  is  a  clutter  on  the  set  of  arcs  in  a  connected  network,  as  is  the  set  of  (minimal)  cutsets. 

The  set  (d*(Y):  Y  6  B)  fully  describes  the  objective  function  w  for  basic  strings  of  £,  however  w(X)  for  X  €  £ 
-  B  is  still  left  undetermined.  We  extend  the  notion  of  determining  structures  to  nonbasic  strings.  Let  X  be  a 
nonbasic  element  of  C-   Define  T(X)  as  T(X)  =  (d*(Y):  XCY.YeB).  Thus,  T(X)  is  the  set  of  determining 

structures  of  basic  strings  which  can  terminate  any  chain  of  access  containing  X.  Let 


w(X)  =  maxd*(Y)€rw    SdVv(x) 


(2.1) 


and  let  d  (X)  =  d  (Y)  n  X  for  the  maximizing  Y  e  T(X).  Note  that  d  (X)  implicitly  depends  on  the  weight  function 
v.  The  triple  (E,  £,  d  )  will  denote  a  system  with  ground  set  E,  feasible  strings  z,  and  determining  structure  function 


Example   1.     (A  Shortest  Path  Example) 

Consider  the  graph  G  =  (N,  E)  in  Figure  1. 


Figure    1. 

Let  E  be  the  set  of  arcs.  Construct  £  so  that  X  e  £  if  X  is  the  arc  set  of  a  directed  tree  rooted  at  node  1.  Further 
restrict  £  by  requiring  that  any  string  containing  an  arc  incident  with  node  4  is  basic. 


E  =  {a,  b,  c,  d,  e),  and  C,  =  {<)),  a,  b,  ab,  ac,  ad,  ba,  be,  abd,  abe,  acd,  ace,  bad,  bae},  B  =  (ad,  be,  abd,  abe,  acd, 
ace,  bad,  bae}.  Note  that  adb  €  £  because  ad  an  arc  incident  with  node  4,  thus  A(ad)  =  0.  For  each  Y  €  B,  let  us 
define  the  determining  structure  of  Y  as  the  (1 ,  4)  directed  path  contained  in  Y.  Thus. 


d*(ad)={a,d)       .  d*(acd)  =  {a,  d) 

d*(be)={b,e)  d*(ace)=  {a,c,e} 

d*(abd)  =  {a,  d}                                                   d*(bad)  =  {a,  d} 
d*(abe)  =  f  b,  e} d*(bae)=  fb.e). 


Note  that  each  element  of  E  is  contained  in  at  least  one  determining  structure.  Also  note  that  no  determining 
structure  is  strictly  included  in  another.  Thus  (d  (Y):  Y  €  B  }  is  indeed  a  clutter  on  E.  Note  also  that  several 
elements  of  z  have  the  same  determining  structure,  thus  their  objective  function  values  are  equal.  Without 
knowledge  of  v,  we  cannot  say  what  the  determining  structure  of  nonbasic  strings  are.  For  instance,  the  determining 
structure  of  the  string  ab  is  the  longer  of  the  arcs  a  and  b. 

2.2    Greedy   Minimizing    Algorithm 

Let  X  e  £.   Define  the  greedy  generator  G  as  the  function  G(X)  =  argminx€A(X)  w(X-x).  A  greedy  chain  of 
access  is  a  chain  of  access  Xq  =  0,  Xy  X,, ...,  Xk  such  that  X.+.  =  X.  •  G(X.).  The  greedily  accessed  basic  string  will 

be  denoted  with  a  subscript  "G".  A  greedy  system  has  the  property  that  for  any  nonnegative  weight  function  v, 
wCYq)  <  w(Y)  for  all  Y  e  B. 

Example  2.     (The  Greedy  System) 

Recall  our  network  example  for  Figure  1.  Let  the  weight  function  v  be  given  by  the  following  table. 


Let  OUT(n)  =  (x  e  E:  tail(x)  =  n}  and  IN(n)  =  (x  6  E:  head(x)  =  n}  for  each  n  €  N.  The  following  algorithm  is  the 
greedy  algorithm  for  this  system 

initialize: 
Xo  =  0 
AfXg)  =  OUT(s) 

MXJ  =  0 


for  each  x  s  E,  r(x)  =  v(x) 

1  =  0 
While  /X.  n  IN(t)  I  =  0 

xM  =  argnunxeA(Xi)  r(x) 

X      =X.   x .  , 

w(X   .)  =  w(X.)  +  r(x.  .) 

A(X.+])  =  A(Xt)  -  /x+;;  -  {x  e  E:  no  (tail(x),  t)  directed  path  exists  in  (N,  E-X.+l)  u  OUT(head(xi+J))} 

i  =  i  +  l 
endwhile 

The  set  of  feasible  strings  z  is  the  set  of  strings  which  this  algorithm  generates  for  all  possible  nonnegative  length 
functions  v.  The  following  table  gives  the  outcome  of  the  algorithm  for  the  network  above. 


i 

X> 

d*(X,) 

w(Xs) 

xe 

A(X.) 

w(X.-  x) 

0 

0 

0 

0 

a 
b 

2 
4 

1 

a 

{a} 

2 

b 
c 
d 

4 
7 
6 

2 

ab 

{b} 

4 

d 
e 

6 

5 

3 

abe 

fb.e) 

5 

- 

— 

The  example  ends  with  X3  =  XG  =  abe.    • 

The  reader  should  recognize  this  algorithm  as  Dijkstra's  shortest  path  algorithm.  In  fact,  several  of  our  greedy 
systems  are  recasts  of  well-known  network  optimization  schemes,  the  hereditary  family  (E,  Q  being  set  of  sample 
paths  for  the  algorithm.  While  this  representation  is  inefficient  for  the  deterministic  problem,  it  is  vital  for  the 
extension  to  the  case  of  random  weights. 

3.0    CONSTANT    ACCESS    AND   INTERVAL    PROPERTIES 

We  must  further  restrict  our  optimization  scheme  in  order  to  guarantee  memorylessness  of  the  random  weighted 
extension.  Ideally,  further  restriction  of  the  deterministic  system  should  be  independent  of  v  except  where  it  impacts 


d  ,  and  locally  verifiable,  having  to  do  with  the  relationship  of  X  to  A(X).  The  following  two  properties  meet  this 
ideal  and  guarantee  memory lessness  to  randomly  weighted  systems. 

3.1   Interval   Property 

The  following  property,  the  interval  property,  is  an  extension  of  the  interval  property  given  by  Korte'  and 
Lovasz  [1984]  in  their  description  of  a  set  of  greedoids  called  alternative  precedence  structure  (APS)  greedoids. 

Let  (E,  0  be  a  hereditary  language.  Let  X,  Y  e  £  such  that  X  C  Y.  (E,  Q  has  the  interval  property  if  for 
all  Z  e  C  with  X  C  Z  C  Y,  we  have 

[A(X)nA(Y)]CA(Z). 

Thus,  during  construction  of  a  chain  of  access,  if  x  e  E  becomes  accessible  at  some  stage,  call  it  j(x).   x  remains 

accessible  until  either  it  is  accessed  or  removed  from  the  set  of  accessible  elements.  Once  an  element  is  removed 

from  the  set  of  accessible  elements,  it  will  never  be  accessible  again. 

Example    3. 

Returning  to  the  ongoing  example,  consider  arc  d.  At  the  onset,  d  is  not  accessible.  Consider  the  string  abe  e 
B.  For  this  string,  d  is  accessible  once  a  has  been  accessed,  thus  j(d)  =  1.  d  remains  accessible  during  stages  2  and 
3.  Once  e  is  appended  to  ab,  d  is  no  longer  accessible.  This  property  can  be  verified  for  all  elements  of  E  for  each 
member  of  B.       • 

-3.2   Constant   Access   Property 
The  system  (E,  £,  d  )  has  the  constant  access  property  if  for  each  X  e  C,  -  B  and  each  Y  e  B  with  X  C 

Y, 

I  A(X)  n  d*(Y)  |  =1. 

Equivalently,  (E,  £,  d*)  has  the  constant  access  property  if  for  all  x  €  A(X),  x  =  X  n  P  for  some  P  6  r(X).  In  a 

subsequent  investigation,  we  will  generalize  this  property  to  allow  |  A(X)  n  d*(Y)  I  =  n(X),  where  n(X)  is  a  known 

constant  depending  only  on  X. 


Example    4. 

In  our  ongoing  example,  note  that  for  each  X  e  C,  -  B,  A(X)  is  contained  in  a  (1, 4)  cutset  and  consists  of  the 
arcs  pointing  toward  node  4  (a  uniformly  directed  cutset,  UDC),  resulting  in  |  A(X)  n  P  |  =  1  for  all  sets  P  which 
are  (1, 4)  directed  paths,  (Sigal,  et.  al.  [1980]).     • 

Greedy  systems  which  have  the  constant  access  and  interval  properties,  are  greedy  systems,  and  have 
determining  structures  which  form  a  clutter  on  the  ground  set  are  called  constant  access  systems. 

3.3   Systems  with   the   Constant   Access   Property 

Henceforth,  (E,  £,  d  )  will  be  assumed  to  be  a  constant  access  system.  We  will  now  present  a  set  of  results 
which  give  a  formula  for  the  cost  of  constructing  the  greedy  chain  of  access.  This  formula  is  the  key  to  the  proof  of 
memorylessness  in  the  next  section,  as  well  as  enhancing  our  understanding  of  deterministic  greedy  access  systems. 

For  any  X  e  £,  X  =  (xr  x2,  ...,  xn),  let  j(x.)  =  min{j:  Xje  A(X.)}  for  each  i  =  1,  2,  ...,  n.  Thus,  j(x.)  is  the 
first  stage  for  which  Xj  is  accessible. 

Lemma  1.  Let  Ye  B,  Y  =  (yr  y    ...,  y  ),   Let  i  and  k  be  such  that  i  <  k  <  m.   Then  y.Ed  (Y  )  implies  that 

YfyO  *  dX). 

Proof.  Consider  the  stage  j(yi)  -  1,  the  stage  immediately  preceding  the  stage  when  y  becomes  accessible.  By  the 
constant  access  property,  there  exists  unique  x  e  d  (Y  )  in  the  set  A(Y  xj).  If  yj  e  A(Y  )  n  d  (Y  ),  then  x  e 
A(Y     )  because  only  one  member  of  d  (Y  )  may  be  in  A(Y     ).  Thus  x  is  in  A(Y        ),  x  is  not  in  A(Y     ),  and  x 

e  d  (Yk)  hence  x  e  Y  .  The  interval  property  guarantees  that  x  =  yj  ...    • 

Upon  reflection,  lemma  1  gives  good  insight  into  the  workings  of  access  systems  with  the  constant  access  and 
interval  properties.  It  states  that  once  one  member  of  the  determining  structure  is  identified,  the  members  of  the 
determining  structure  accessed  before  it  are  known  automatically.  In  the  next  lemma,  we  establish  that  if  an  element 
X  is  generated  greedily,  the  last  element  of  X  is  a  member  of  d(X). 

Lemma  2.  Let  (E,  £,  d*)  be  a  constant  access  system.  Let  X  be  a  greedily  generated  string,  |  X  I  =  n.  Then  for 

each  x  e  A(X),  x  e  d*(X-x). 

Proof.  See  appendix  A. 

Lemma  2  is  based  on  some  observations  about  the  greedy  generator.  Consider  the  possibility  that  x  £  d  (X  • 
x).  In  this  case  w(X)  =  w(X  ■  x)  and  accessing  x  is  "free."  Two  possibilities  exist.  Possibly  x  has  been  accessible 


before  stage  m,  in  which  case  we  would  have  accessed  this  low  cost  element  before  this  stage.  The  other  possibility 
is  that  x  was  not  accessible  before  stage  m.  In  this  case,  j(x)  =  m.  This  implies  that  x  and  xm  are  both  members  of 
some  element  K  of  T(X  •  x)  and 

ZZ€Kr<x  •*)    v(z>=    VW+  S^KrtX  v(z) 
so  accessing  x  is  certainly  not  costless.  Hence  we  derive  a  contradiction  in  either  case. 

Thus,  the  greedily  generated  elements  X  e  £  are  closed  in  the  sense  that  feasibly  adding  any  element  of  E  -  X 
increases  the  objective  function  value  of  the  string. 

Lemma  3.  Let  Xj  e  C  be  generated  by  the  greedy  generator.  Let  xk  =  w(Xk)  -w(Xk_  ),  k  =  1,  2, ...,  i.  For  each  z 
e  A(X.),  let  Cz  =  v(z)  -  [xj(i)+1  +  t.(z)+2  +  ...  +  t.].  Then 

w(X.-z)-w(X.)  =  C.  (3.1) 

Proof.  Consider  z  e  A(X .).  Let  J  €  T(X.  •  z)  such  that 

^xeJnOqufz))   V(X)   -   ^-xeJVXXMz))   V(X) 

for  all  J'  e  T(Xy  ■  z),  thus  J  n  (Xj  u  {z})  =  d  (Xj  •  z).  By  lemma  2,  we  know  that  z  €  J,  and  by  the  constant  access 
property  {xj(z)+1  +  xj(z)+2  +  ...  +  xj)  n  d*(X  •  z)  =  0.  Thus  w(Xj  •  z)  =  w(Xj(zp  +  v(z).  Thus,  the  definition  of 
the  t's  gives  us  the  result 

w(Xj  •  z)  -  w(Xj)  =  v(z)  -  [tj(z)+i  +  Xj(z)+2  +  ~.  +  Xj].     •  (3.2) 

Corollary  4.  G(Xj)  =  argminzeA(Xi)  Cz. 

Proof.  A  result  of  lemma  3  and  the  definition  of  the  greedy  algorithm.    • 

Lemma  3  enables  us  to  directly  compare  the  incremental  costs  of  the  elements  appendable  at  a  given  stage.  In 
the  sequel,  we  will  consider  the  case  where  (v(x):  x  e  E}  is  a  set  of  independent,  exponentially  distributed  random 
variables.    We  will  use  lemma  3  to  show  that  at  each  stage,  the  costs  C    are  memoryless  with  respect  to  the 

elements  already  accessed,  and  thus  the  incremental  costs  of  access  remain  independent  and  exponentially  distributed. 

Example    5. 

Let  us  return  again  to  our  ongoing  example,  the  weights  of  the  arcs  given  by 


Consider  the  siring  X  =  ac,  which  the  greedily  generated  string  of  length  2.  A(ac)  =  {d,  e},  with  j(d)  =  1  andj(e)  =  2. 
By  lemma  2,  d  e  d*(acd)  and  e  e  d(ace).  By  lemma  1  we  identify  d  (acd)  as  {d,  x  ...}  =  {d,  a},  and  d*(ace)  =  {e, 
x     , ...}  =  {e,  c,  a),  both  sets  are  arc  sets  of  (1,4)  directed  paths.  By  lemma  3,  w(acd)  -  w(ac)  =  C  =  v(d)-T  =  v(d) 

-  [w(ac)  -  w(a)]  =  v(d)  -  [v(c)  -  0]  =  3.  w(ace)  -  w(ac)  =  Ce  =  v(e)  -0=1. 
YG  =  ace,  as  predicted  by  corollary  4.     • 

4.0      STOCHASTIC    CONSTANT    ACCESS    SYSTEMS 

We  are  primarily  interested  in  models  of  system  behavior  in  which  the  critical  measure  of  performance  is  a  sum 
of  the  weights  of  a  determining  structure  of  a  basic  element  In  the  last  section,  we  have  developed  characteristics  of 
these  types  of  optimization  problems  when  the  weight  function  is  a  known  function  v:E  — >  9\+.  We  now  wish  to 
consider  situations  in  which  {V(x) :  x  e  E}  is  a  set  of  random  weights  of  ground  set  elements,  however,  we  wish  to 
solve  the  minimum  weight  basic  element  problem  using  greedy  minimization  which  implies  definite  knowledge  of 
the  incremental  costs  of  adding  various  elements  of  the  accessible  set  at  each  stage.  We  thus  propose  the  following 
scenario:  at  the  time  that  the  optimization  is  to  take  place,  the  ground  set  weights  (arc  lengths  in  our  examples)  are 
known.  However,  prior  to  any  realization  of  the  problem  being  encountered,  (V(x)  :  x  e  E)  is  a  set  of  random 
weights  for  which  we  have  distributional  knowledge.  Thus,  from  a  strategic  point  of  view,  the  constant  access 
system  being  considered  may  be  analyzed  as  a  system  with  stochastic  performance.  Tactically,  the  system  is  seen 
as  a  deterministic  greedy  problem. 

Accordingly,  we  will  now  conside'r  the  case  of  optimization  in  the  context  of  uncertainty.  Let  (V(x)  :xeE) 
be  a  set  of  nonnegative  random  weights,  and  let  {W(X)  :  X  e  Q  be  the  associated  set  of  stochastic  determining 
structure  objective  function  values.  Thus,  we  wish  to  derive  the  joint  distribution  function  F  given  by 

F(Y,  t)  =  P[W(Y)  <  t,  W(Y)  <  WOO  for  all  Y1  e  B] 

for  each  Y  e  B.  With  F  in  hand,  the  derivation  of 

pO0  =  limt_+-FOr,0; 

F(t)  =  ZYeBFOT,t); 
which  represent  the  probability  a  basic  element  Y  is  optimal  and  the  distribution  of  the  minimum  weight  basic 
element,  resp.,  are  direct  We  will  also  demonstrate  some  straightforward  methods  for  deriving  performance  measure 
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distributions,  expected  values,  and  conditional  expected  values,  all  of  which  exploit  the  properties  of  the  Markov 
process  we  develop. 

4.1      Sample   Paths   of  the   Greedy  Minimizing   Algorithm 

As  mentioned  in  the  introduction,  we  will  model  the  execution  of  the  greedy  algorithm  as  a  stochastic  process, 
a  novelty  in  the  literature  of  stochastic  combinatorial  optimization.  Let  {X(t),  t  >  0}  be  a  time  homogeneous 
stochastic  process  on  state  space  C  with  transition  epoches  Sn  =  0,  S,,  S„  ....  and  intertransition  times  t  =  S  -  S 

(X(t),  t  >  0}  has  the  following  qualities: 
i)     P[X(O)  =  0]=1; 
ii)    P[X(t  +  s)  =  Y  |  X(s)  =  Y]  =  1  for  all  Y  e  B,  s,t  >  0; 

iii)     P[X(Sn)  =  X-x,xn  =  t  I  X(Sn_1)  =  X] 

=  P[W(X-x)  -  W(X)  <  W(X-y)  -  W(X)  for  all  y  e  A(X),  W(X-x)  -  W(X)  =  t]. 
Hence,  (X(t),  t  >  0)  starts  in  0,  and  is  absorbed  in  any  element  of  B.    Furthermore,  the  probability  of  making 
transition  from  X  to  X  •  x  occurs  after  W(X  ■  x)  -  W(X)  time  units,  and  then  only  if  transition  to  X  •  y  for  some 
other  y  e  A(X)  hasn't  already  occurred.  By  virtue  of  i  -  iii,  we  may  extend  the  definition  of  F  to  include  nonbasic 
elements  of  £: 

F(X,  t)  =  P[W(X)  <  W(X')  for  all  X  e  C,  I X'  |  >  |  X  | ,  W(X)  <  tj. 

Thus,  F(X,  t)  is  the  probability  that  X  is  on  the  (random)  greedy  sequence  and  that  its  objective  function  value  is 

less  than  or  equal  to  L  Since  the  length  of  X  increases  at  each  stage,  we  may  guarantee  that  the  transition  matrix  of 

the  underlying  discrete  process  of  X(t)  is  uppertriangular  by  assuming  that  the  elements  are  listed  in  increasing 

length. 

Note  that  without  any  further  distributional  assumptions,  (X(t),  t  >  0}  is  a  generalized  semi-Markov  process 
(GSMP),  and  that  imposition  of  the  interval  property  on  (E,  Q  restricts  {X(t),  t  >  0}  to  the  set  of  noninteruptive 
GSMPs,  see  Schassberger  [1976].  However,  results  concerning  GSMPs  are  almost  exclusively  concerned  with 
steady  state  behavior  of  the  system.  Because  the  characteristics  of  (X(t),  t  >  0)  we  seek  concern  transient  behavior, 
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GSMP  theory  is  of  Utile  help  in  the  current  context.  Research  into  characteristics  of  GSMPs  with  uppertriangular 
transition  matrices  may  be  motivated  by  the  systems  discussed  in  this  paper. 

4.2      Exponentially    Distributed    Weights 

Let  { V(x) :  x  e  E)  be  a  set  of  mutually  independent,  exponentially  distributed  random  variables  with  rates  (ji(x)  :  x 
e  E}.  Recall  that  j(y)  =  min  {j:  y  e  A(Y)}. 

Lemma  5.  Let  Y  e  £,  I  Y  I  =  n.  Let  y  e  A(Y).  Then 

P[V(y)  >  t  +  x ,  ,  ,  +  Xj,  ,,  +  ...+  T    I  X(S.)  =  Y.,  X.,  ,  ,  x.,  ,  ,  ...  ,  x  ] 

L     w/  j(y)+l  J(y)+2  n  v    iJ  i»     j(y)+l,     j(y)+2,         '     nJ 

=  P[V(y)  >  t]  =  t^y)\  (4.1) 

Furthermore,  given  X(S  )  =  Y.,  x.,  ,  ,,  t .,  ,  ., ... ,  x.,  the  set  of  random  variables 

'  *>  v    v  i'    j(y)+l'    j(y)+2'  i' 

{ V(y)  -  x.,  .  j  -  x.  )+2  -  ...  - 1. :  y  €  A(Y.)}  is  a  set  of  mutually  independent  random  variables. 

Proof.    We  induct  on  i.    For  i  =  0,  the  proposition  simplifies  to  the  assumption  of  independent,  exponentially 

distributed  weights,  j(x)  =  0  for  all  x  e  A(0). 

Consider  the  lemma  statement  as  an  induction  hypothesis  true  for  0,  1,  ....  i.  For  every  y  e  A(Y),  equation 
4.1  is  true  for  j(y)  +  1,  ...,  i.   Note  that  the  condition  X(S.)  =  Y  implies  that  for  every  y  €  A(Y),  V(y)  >  x         - 

Tj(y)+2---Ti-  Thus 

T.  =  min  (V(y)  -  Tj(y)+1  -  X^2  - ...  -  xn  :  y  €  AQQ)  ~  min  {V(y)  :  y  €  AfY^} 

is  the  minimum  of  a  set  of  mutually  independent,  exponentially  distributed  random  variables,  which  implies  that  x.+1 

~  exp  n(Y.),  where 

MO^-S^.iKy).  (4-2) 

By  invoking  the  strong  memory  less  property,  we  have    { V(y)  -  T;(  )+1  -  x\.  )+2  -  ...  -x.  -  xi+1:  y  e    A(Yp  n 
A(Y.+1)]  is  a  set  of  independent,  exponentially  distributed  random  variables  because  A(Y.)  is  assumed  to  be  a  set  of 

independent  random  variables.  Since  {y:  j(y)  =  i  +  1}  are  assumed  to  be  independent  of  the  history  of  (X(t)}  to  this 
point,  we  have  established  that  { V(y)  -  T.(x)+1  -  x(x)+2  -  ...  -  x.-  X.+1:  y  e   A(Yi+1)}  is  a  set  of  independent, 

exponentially  distributed  random  variables.  • 
Let  Q  be  an  |  £  |  x  |  ^  |  matrix  given  by 
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Y  =  Xx  e   C 

X  =  Y  (4.3) 

otherwise. 

Theorem  6.    {X(t),  t  >  0}  is  a  continuous  time  Markov  chain  with  infinitesimal  generator  matrix  Q. 
Proof.  Let  Y  6  £,  I  Y  |  =  k.  By  lemma  3,  we  know  that,  conditioned  only  on  the  greediness  of  Y, 
W(Y  •  y)  -  W(Y)  =  V(Y)  -  [Tj(y)  +  tj(y)+1  +  ...  +  xj 

for  each  y  €  A(Y).  Thus,  the  implication  of  lemma  5  is  that,  conditioned  on  Y  being  greedy,  the  set  { W(Y  •  y)  - 
W(Y):  y  6  A(Y)}  is  a  set  of  mutually  independent,  exponentially  distributed  random  variables. 
Let  Px  Y(t)  =  P[X(t)  =  Y  |  X(0)  =  X]  for  each  pair  X,  Y  e  C- 
Corollary  7.  Let  Y  €  B.  Then  F(Y,  t)  =  P[X(t)  =  Y]  =  P0y(t) 

Proof.   We  designed  (X(t)}  such  that  sample  paths  of  this  process  are  greedy  access  chains.   Since  (E,  £,  d*)  is 

assumed  to  be  a  greedy  system,  sample  paths  terminate  in  greedy  optimal  basic  elements.    • 

Thus,  we  have  shown  that  F(Y,  t)  is  a  first  passage  time  distribution  of  a  Markov  process  with  state  space  £ 
and  generator  matrix  Q. 

Example    6. 

Reconsider  the  ongoing  shortest  path  example.  Suppose  we  wished  to  find  F(abd,  t).  We  can  write  the 
Kolmogorov  equation  P'(t)  =  P(t)Q  as  a  set  of  first  order  differential  equations  which  may  be  solved  iteratively.  In 
the  case  of  abd,  the  system  is  given  by 

P0^'(O  =  -[li(a)  +  *i(b)]  P0i0("t) 

P0b'(t)  =  n(b)  P00(t)  -  [n(a)  +  tfe)]  P0b(t) 

P0fba'(D  =  H(a)P0ib(t)  -  &i(d)  +  [1(e)]  P0bi(t) 

P0.b.d'(t)  =  ^d)P0.ba(t). 

When  the  rates  are  given  by: 

H(a)  =  2;  n(b)=l;  ^(c)  =  4; 

^d)=l;  ^(e)  =  3 

this  system  has  soludon 

F(bad,  t)  =  P0)bad(t)  =  PfW(bad)  <  W(Y)  for  all  Y  e  B,  W(bad)  <  t] 
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=  1/30  -  1/3  e  3t  -  1/5  e  5t  +  1/2  e-47 


4.3   Performance   Measures 

In  this  section,  we  discuss  some  of  the  uses  of  the  distribution  F(Y,  t)  in  characterizing  some  measures  of 
performance  of  the  stochastic  constant  access  system.  While  the  fundamental  equations 

i)     F(Pit  t)  =  P[W(Y)  <  t  for  some  Y  €  B  such  that  d*(Y)  =  P;] 

=  ^Y:d*m  -  ^  F<X  0  for  each  pi  e  {d*00:  Y  e  B } 
ii)    F(t)  =  P[W(Y)  <  t  for  some  Y  e  B]  =  IYeB  F(Y,  t) 

iii)     PY  =  P[W(Y)  <  W(Y')  for  all  Y'  e  B]  =  Urn  t  ^  „  F(Y,  t) 
are  obviously  valid,  there  exist  more  efficient  methods  for  the  computation  of  these  distributions  that  do  not  require 
full  knowledge  of  F(Y,  t)  or  even  generation  of  every  element  of  £.  Historically,  studies  cited  in  the  introduction 
were  focused  on  the  calculation  of  F(t)  for  each  example  problem.  Analysts  undertaking  analysis  of  some  stochastic 

constant  access  system  may  have  no  need  for  the  joint  distribution. 

Let  P  =  {P^  P.  =  d  (Y)  for  some  Y  e  B).  Let  C,p  =  (£  -  B)  u  P.    Consider  the  modified  continuous  time 

p 
Markov  chain  (Xp(t),  t  >  0}  on  state  space  £p  with  transition  probability  matrix  Q    given  by 

QPx.y  =  Qx,y  X,Ye£-B 

QPXPi=Qx.Y  Y€_B,d*(Y)  =  P.. 

Through  this  simple  combining  of  basic  elements  of  £,  we  have  created  a  new  process  for  which  the  absorption 
distribution  is  P[Xp(t)  =  P.  I  Xp(0)  =  <))]=  F(P ,  t).  For  the  shortest  path  problem,  F(P.,  t)  is  the  probability  that 
P.  is  the  shortest  path  and  it's  length  is  less  than  or  equal  to  t. 

Arguably,  the  process  (Xp(t)}  makes  {X(t))  obsolete,  as  we  are  rarely  interested  in  all  of  the  sample  path 
information  {X(t)}  can  provide.   More  to  the  point,  {Xp(t)}  seems  to  be  very  inefficient  because  it  has  several 

indistinguishable  sample  paths.  The  process  (X  (t)}  may  be  streamlined  by  performing  the  following  procedure  on 

p 
the  matrix  Q    and  state  space  £p.   We  call  this  procedure  the  lumping  procedure  for  determining  structure 

absorption. 

initialize: 
L=P. 
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while  there  exist  X,Z  e  Cp  such  that  Q  x,\V  ~Q  Z,W  ~  °for  all  W  e  (,p-L  and  Q  x  W  ~  Q  ZW  for 

allW  e  L 

P  P  P 

for  every  T  e  Qp,  replace  Q  TJC  with  Q  TJC  +  Q  T;z 

remove  Zfrom  C,p 

p 

replace  L  with  L  u  {X  e  C,p:  Q  xw  =  Ofor  all  We  C,p-L) 

repeat. 

Note  that  performing  the  lumping  procedure  preserves  the  uppertriangularity  of  generator  matrices.  An 
analogous  procedure  may  be  constructed  for  any  set  of  combined  absorbing  states,  and  the  procedure  extends  to 
discrete  time  Markov  chains  in  the  obvious  way.  The  theoretical  importance  of  the  lumping  procedure  is  that  it 
assures  us  that  the  system  we  choose  to  analyze  has  no  redundant  sample  paths.  In  applications,  we  often  use  the 
lumping  procedure  in  the  abstract,  lumping  state  space  elements  by  some  structural  argument.  In  this  case,  the 
lumping  procedure  provides  sufficient  conditions  for  the  validity  of  such  an  argument 

The  distribution  of  the  weight  of  the  optimal  basic  element  may  be  derived  via  a  method  similar  to  the  one  just 
described.  Suppose  we  combined  all  of  the  basic  elements  into  a  single  element  VF,  defining  £vp  =  (£  -  B)  u  {¥] 
and  (Xvj/(t),  t  >  0}  with  generator  Q     defined  by 

Q    x  Y  =  Qx  Y  if  Y  €  B 

Q     X,Y  =  -^Y€B    Qx,V 

Then  PfX^Ct)  =  Y  |  XY(0)  =  <()]  =  F(t)  is  the  distribution  of  the  weight  of  the  minimum  weight  clutter  element. 
Example    7. 

By  lumping  the  states  with  identical  determining  structures  and  performing  the  lumping  procedure,  we  greatly 
reduce  the  size  of  the  state  space.  This  reduces  the  sate  space  size  from  I  £  I  =  14  to  I CP I  =  8.  If  we  are  interested 
only  in  F(t),  the  distribution  of  the  shortest  path,  we  may  further  reduce  the  state  space  size  to   |  ^  |  =  5.  On  larger 

or  denser  networks,  these  reductions  are  more  pronounced. 

We  need  not  generate  the  original  state  space  C,  to  generate  CorL.  For  the  shortest  path  problem,  nonbasic 

states  with  identical  acessible  sets  may  be  lumped  to  give  CP-  The  same  is  true  of  I  Cy  I  •  Thus,  we  may  perform 

the  lumping  procedure  in  the  abstract,  avoiding  the  computational  work  entailed  in  generating  £. 
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4.4  Performance  Measures  Based  on  the  Embedded  Markov  Chain 

Let  {Yn,  n  >  0}be  the  embedded  discrete  time  Markov  chain  for  {X(t)}.  Thus,  (Yn)  has  state  space  C,  and 
transition  probability  matrix  P  given  by 

Px.x-x^W^TOf1  (4.4) 

for  Xx  e  £.  For  the  process  {Yn},  there  is  exactly  one  sample  path  from  <{>  to  each  member  of  B.  Thus,  for  Y  e 
B,  I Y  |  =  m,  we  have  the  solution 

PY  =  P[YG  =  Y]  =  U^tX ^  H(y.)  [nCYi.,)]"1;  (4.5) 

Some  measures  easily  derivable  by  summing  different  subsets  of  {PY:  Y  e  B)  from  {Yn}  are 

i)     P[d*(YG)  =  Pj]  for  each  P,eP 

ii)    P[x  e  d  (YG)]  for  some  x  e  E 

iii)  P[|YG|  =m],m=l,2 |e| 

iv)  P[|d*(Y)|  =i],i  =  l,2,...,  |e|. 
The  first  measure  is  the  probability  that  a  given  determining  structure  is  the  minimum  weight  determining  structure. 
For  the  shortest  path  example,  this  is  the  probability  that  a  given  path  is  shortest  The  second  density  gives  the 
probabibty  that  a  given  element  of  E  is  a  member  of  the  optimal  determining  structure,  this  is  the  probability  that  a 
given  arc  is  on  the  shortest  path.  The  third  density  function  gives  the  distribution  of  the  length  of  the  optimal 
element.  This  is  the  number  of  steps  taken  by  the  greedy  algorithm  in  solving  the  given  problem—the  distribution 
of  the  execution  time  of  the  algorithm.  Finally,  the  last  density  gives  the  probability  that  the  optimal  determining 
structure  is  of  a  given  length.  This  density  is  especially  interesting  if  |i(x)  is  the  same  for  each  x  e  E.  Each  of 
these  measures  may  also  be  calculated  efficiently  by  lumping  absorbing  states  in  the  obvious  way  and  performing 
the  lumping  procedure. 

For  any  Markov  chain  {Zn,  n  >  0}  with  transition  probability  matrix  P  with  strictly  uppertriangular  transition 
probability  matrix,  we  solve  the  system 

P0  =  i; 

Py  =  ^xe;PxPx.Y 
direcdy  for  the  set  {Py:  Y  is  absorbing  in  (Zn} } . 

Example   8. 
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Returning  to  the 

ongoing  sr 

ortest  path  example. 

we 

have  the  following 

table  for  the  basic  elements: 

Y  e    B 

P[Y  =  YG] 

Y  g    B 

P[Y  =  YG] 

ad 

0.1111 

acd 

0.1111 

be 

0.2000 

ace 

0.3333 

abd 

0.0278 

bad 

0.0333 

abe 

0.0833 

bae 

0.1000 

and  for  the  directed  (s.  t)  paths: 


path   set  Pi 

PfPi  is  the  shortest  path   in  G] 

{b,e} 

0.3833 

M) 

0.2833 

{a,  c,e} 

0.3333 

and  criticality  indices 

arc 

X 

P[x 

is 

on 

the 

shortest  path  in   G] 

a 

0.6166 

b 

0.3833 

c 

0.3333 

d 

0.2833 

e 

0.7166 

"4.5   Expected    Value   Analysis 

All  of  the  Markov  process's  we  have  considered,  regardless  of  any  lumping  performed,  have  uppertriangular 

generator  matrices.  We  present  here  three  simple  formulae  for  the  computation  of  the  k     moment  of  the  conditional 

time  until  absorption  of  a  Markov  process  with  uppertriangular  generator  matrix.   Let  Q  be  the  generator  of  the 

vp  p 

original  process  (X(t),  t  >  0),  let  Q     and  Q    be  the  generators  defined  above.   Let  Y  e  B  and  R  e  P.  Let  Ux, 

Ux|p.,  andUx|Y  be  given  by 

Ux  =  inf{C  X^(t)  e  V  I  X^O)  =  X)  for  every  Xe^ 

Ux)Pi  =  inf{t  Xp(t)  =  P.  I  Xp(0)  =  X,  Urn  t_.  Xp(t)  =  PJ  for  every  X  e  CP 

UX|Y  =  inf{t:  X(t)  =  Y  |  X(0)  =  X,  lim  t  _ ..  X(t)  =  Y)  for  every  X  e  C 

k  k  k 

and  defme  me  moments  Tx(k),Tx|p.(k),  and  ix|y(k)  as  EUX  ,EUx|p.  ,andEUx|Y  ,resp.  We  seek  the  quanuues 
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T6(k)  =  E[W(YG)k] 


TjPi(k)  =  E[W(YG)k|d*(YG)  =  Pi] 

T0|Y(k)  =  E[W(YG)k  |  YG  =  Y]. 
The  first  step  equation  for  Ux  is  given  by 

Ux  =  [l  +  2^,  Q^x^z]  H^wcf  -  (4-6) 

with  Uxj,  =  0.  Using  moment  generating  functions,  we  derive 

xx(k)  =  [kxx(k  -  1)  +  L^  QTX>Z  xz(k)]  [-Q^r  (4-7> 

for  each  Xe  ^  and  each  k  =  1,2 and  with  T^,(k)  =  0.  Using  ix(0)  =  1  for  all  X  e  ^  as  a  boundary  condition, 

we  can  directly  compute  (xx(k):  Xe  ^)  from  {xx(k  -  1):  X  e  ^}  and  Q**\  In  the  case  of  k  =  1,  equation  4.7 

simplifies  to  the  familiar  first  step  expected  value  equations 

*xa)  =  ["Q4'x.xf    ♦^P^WD  (4-8) 

\p  vp  \p        — 1 

where  P    x2  =  Q    x.z  f~"Q    x.xl      is  the  transition  probabiUty  from  X  to  Z  for  the  process  (X>j,(t)). 

With  minor  modifications  to  this  methodology,  we  may  find  tx|p(k)  for  each  X  e  £p.  Let  us  define  the  set 
Cp  =  {Xe  £p:  P[Xp(t)  =   Pj  I  Xp(0)  =  X]    >  0),  thus  Cp  is  the  subset  of  C,p  which  communicates  with  P; . 

Following  4.7,  we  find 

Tx,Pi(k)  =  [krx,p.(k - 1)  +  I^Ck QPXiZ Xzip.Ck)]  [Vx/  .  (4-9) 

Tp.  |p.(k)  =  0.  Note  that,  consistent  with  a  fundamental  property  of  Markov  process,  the  expected  sojourn  time  in 

state  X  is  unaffected  by  the  conditioning.  The  form  of  4.7  can  also  be  used  to  find  the  expected  value  x-%  |  yfc). 

-1 
Tx|Y(k)  =  [kTx|Y(k-l)  +  IZcYQx2Tz|Pi(k)][-Qx;c]     .  (4.10) 

As  mentioned  before,  the  original  process  (X(t),  t  >  0}  has  a  unique  sample  path  to  each  basic  element  Let  I  Y  |  = 

m,  then  for  each  i  <  m,  4.10  simplifies  to 

-1 
ty.  |Y(k)  =  kxYi  | Y(k  -  1)  [ZMA(Yi)  MOO]     +  *vi+1 1 Y*  -  *)■ 

Thus 

%\ y00  =  ^^-it^ACVi)  H(*)f  •  (4-11) 

Example    9. 
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Revisiting  our  ongoing  shortest  path  example,  we  calculate  t0(1)  =  0.6833  and  iA2)  =  0.6655.  This  gives  us 
a  shortest  (s,  t)  path  length  variance  of  0.1986.  Note  that  E[v(a)  +  v(c)  +  v(e)]  =  1.0833,  E[v(a)  +  v(d)]  =  1.500,  and 
E[v(b)  +  v(e)]  =  1.333.  Thus,  if  we  were  to  naively  estimate  the  length  of  the  shortest  path  by  the  minimum  of  the 
expected  value  of  the  sums  of  arc  lengths,  we  would  overestimate  the  length  by  0.4,  over  one  standard  deviation. 

5.0      EXAMPLES   FROM   NETWORK   OPTIMIZATION 

In  this  final  section,  we  present  examples  of  constant  access  systems  arising  in  network  optimization.  These 
constant  access  systems  may  be  classified  into  two  groups,  those  which  have  determining  structures  which  are  paths 
or  cutsets  in  the  network  at  hand,  and  those  which  involve  the  bottleneck  objective  function.  Several  of  these 
constant  access  systems  have  already  appeared  in  the  literature  as  separate  results.  The  purpose  of  presenting  them 
here  is  to  highlight  their  interrelationship  and  to  build  die  reader's  intuition  with  familiar  structures.  The  k-rrigger 
network  example  in  Section  5.1  and  all  of  the  bottleneck  objective  function  examples  are  presented  in  the  literature 
for  the  first  time  in  this  paper.  We  shall  illustrate  the  concepts  and  procedures  described  in  sections  2  through  4 
using  these  examples. 

5.1      Stochastic   Path   and   Cutset  Optimization 

In  this  section,  we  present  some  constant  access  systems  in  which  the  determining  structures  are  paths  or 
cutsets.  The  examples  provided  are  the  shortest  path  system  (Kulkarni  [1987]),  the  PERT  system  (Kulkarni  and 
Adlakha[l986]),  the  maximum  flow  on  directed  planar  networks  (Kulkarni  [1987])  and  a  new  system  which  we  call 
the  k-trigger  network. 

Example    10.      (Shortest   Path   Systems) 

We  have  used  an  instance  of  the  shortest  path  problem  to  motivate  theory  we  have  presented  thus  far.  In  this 
section,  we  present  this  problem  in  its  full  generality.  Markov  processes  were  first  used  to  analyze  shortest  paths  in 
Markov  networks  in  Kulkarni  [1987]. 

Let  G  =  (N,  E)  be  a  directed  graph.  Let  s  and  t  be  two  prespecified  nodes  in  N,  and  suppose  that  there  exists  a 
(u,  t)  directed  path  for  each  u  e  N.  We  will  speak  of  a  path  as  a  set  of  directed  arcs,  the  incident  nodes  being 
implicit.  If  x  e  E  is  given  by  the  ordered  pair  (k,  1),  then  we  say  head(x)  =  1  and  tail(x)  =  k.  Let  IN(n)  denote  the  set 
{x  e  E:  head(x)  =  n)  and  OUT(n)  denote  the  set  {x  e  E:  tail(x)  =  n)  for  each  n  e  N. 
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Cast  in  the  notation  of  constant  access  systems,  Dijkstra's  algorithm  for  finding  the  shortest  path  in  G  is  eiven 
by  the  following  algorithm. 

initialize: 
Xo  =  0 
A(X0)  =  OUT(S) 

WPCg)    =  0 

for  each  x  e  E,  r(x)  =  v(x) 
i  =  0 
While  IXi  n  IN(t)  I  =  0 

xi+1  =  argminxeA(Xi)  r(x) 

^i+l  =  *i '  xi*l 

wPCM)  =  w(Xi)  +  r(xi+]) 

A(Xi+])  =  A(X;)  -  {xUJ}  -{xe  E:  no  (tail(x),  t)  directed  path  exists  in  (N,  E  -  XM)  u  OUT(head(xul))} 

i  =  i  +  l 
endwhite 

Let  L,  be  the  set  of  strings  possibly  generated  by  this  algorithm  for  all  nonnegative  length  functions.  Thus,  let  X  be 
a  string  of  arcs,  I  X  I  =  i  and  let  n  =  head(xj).  X  e  £  if  and  only  if 

i)     (N,  X)  is  an  s-rooted  directed  tree; 

ii)    There  exists  at  least  one  directed  (n,  t)  path  P  such  that  none  of  the  nodes  implicit  in  P  are  incident  with 
edges  in  X. 

iii)  Properties  i  and  ii  hold  for  every  prefix  of  X. 
From  these  properties,  it  is  obvious  that  X  e  B  if  and  only  if  head(Xj)  =  t.  The  set  { A(X):  X  e  Q  is  the  set  of 
uniformly  directed  cutsets  (UDCs)  in  G  along  with  the  empty  set. 

The  determining  structure  of  each  Ye  B  is  the  unique  directed  (s,  t)  path  contained  in  (N,  Y).  For  X  e  C,  -  B, 
d  (X)  is  identified  by 

Vpo  v W  =  maxY€  rw  £d*(X)  ox  v00. 
d  (X)  is  the  subset  of  maximum  weight  of  an  (s,  t)  path  contained  in  X,  where  the  maximization  is  performed  over 
those  (s,  t)  paths  which  are  determining  structures  of  basic  elements  for  which  X  is  a  prefix. 
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The  verification  of  the  constant  access  property  for  (A,  £,  d  )  is  a  result  of  SigaJ  et.  al.  [1980].  They  state  that 
the  intersection  of  a  (s,  t)  path  with  a  UDC  is  always  a  single  element  set.  From  our  knowledge  of  Dijkstra's 
algorithm,  we  know  that  an  arc  x  becomes  accessible  as  soon  as  an  arc  incident  with  tail(x)  is  accessed.  It  remains 
accessible  until  it  is  accessed,  or  until  there  remain  no  (head(x),  t)  paths  which  are  not  "crossed"  by  paths  of  accessed 
arcs.  From  this  intuitive  argument,  we  see  that  (A,  £,  d  )  has  the  interval  property. 

Because  (A,  £,  d  )  is  a  greedy  constant  access  system,  we  may  apply  the  results  from  Section  3  to  find  (F(Y, 
t),  Y  e  B,  t  >  0}  when  G  is  a  network  with  arcs  with  independent,  exponentially  distributed  lengths.  The  shortest 
path  system  has  the  property  that  for  each  Ye  B,  (N,  Y)  contains  a  unique  (s,  t)  path.  If  we  were  not  interested  in 
the  actual  order  of  access,  we  would  lose  nothing  by  lumping  together  strings  with  identical  underlying  sets-in  fact, 
the  lumping  procedure  would  do  this  automatically.  This  reduction  in  the  size  of  the  state  space  is  especially 
dramatic  for  dense  graphs.  If  we  were  interested  in  only  the  length  of  the  longest  path,  the  lumping  procedure  would 
combine  all  states  with  the  same  accessible  set.  Thus,  the  state  space  could  be  replaced  by  the  set  of  UDCs. 

We  may  use  the  method  for  shortest  path  problems  to  analyze  maximum  flows  in  undirected  planar  networks 
with  independent,  exponentially  distributed  arc  capacities  by  utilizing  the  topological  dual  of  the  network.  It  is  well 
known  that  the  minimum  capacity  cutset  in  a  planar  network  G  is  identified  as  the  shortest  path  in  the  dual  network 
G',  where  the  arc  lengths  in  G'  are  the  capacities  in  G. 

Example    11.      (Longest   Path   Systems) 

Let  G  =  (N,  E)  be  an  acyclic  directed  network.  Again  let  s  and  t  be  two  prespecified  nodes  in  N,  and  suppose 
that  there  exists  a  (u,  t)  path  for  each  u  e  N..  If  we  add  { v(x):  x  €  A) ,  a  set  of  weights  representing  durations  of  the 
tasks  represented  by  the  arcs,  the  resulting  network  is  called  a  PERT  network.  In  such  a  network,  tail(x)  =  head(y) 
implies  that  activity  y  must  be  completed  before  activity  x  can  commence,  y  has  precedence  over  x.  The  goal  of 
analysis  of  PERT  networks  is  the  identification  of  the  longest  path  in  G  and  its  length.  The  well-known  forward 
sweep  algorithm  for  finding  the  longest  path  in  G  is  given  by  the  following 


initialize: 

Xo  =  0 

A(X0)  =  OUT(s) 

w(Xo)  =  0 

for  each  xe  E,  r(x)  = 

■-v(x) 

i  =  0 
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While  IXi-El  *0 

xl+1  =  argminxeA(Xi)  r(x) 

w(XM)  =  MX)  +  r(xi+]) 

if  iXi  nIN(head(xi+1))  I  =  indegree(head(xl+l))  (hen 
A(Xi+])  =  A(X.)  uOUT(head(xt+1)) 

else 

A(XM)=A(Xi) 

i  =  i  +  l 
endwhile 

Let  C,  be  the  set  of  strings  possible  generated  by  nonnegative  length  functions  and  let  B  be  the  set  of  basic  elements 
of  C-  This  structure  is  the  well-known  schedule  greedoid,  so-named  by  Korte'  and  Lovasz  [1984].  The  determining 
structure  of  Y  e  B,  |  Y  |  =  m,  is  constructed  as  follows: 

i)  ymed*(Y); 

ii)  for  each  y  €  d  (Y),  identify  {y-  ,  y- , ...,  y.  :  head(yij)  =  tail(y)}.  Let  i    =  maxj=1  jjij},  then  y;    e  d  (Y). 
Thus,  the  last  arc  accessed  which  points  into  tail(ym)  is  in  d  (Y),  the  last  arc  accessed  pointing  into  that  arc  is  in 
d  (Y),  and  so  on.   This  backward  chain  ends  when  an  arc  y  with  tail(y)  =  s  is  identified  as  a  member  of  d  (Y), 
forming  a  (s,  t)  path. 

Let  us  verify  that  (A,  £,  d  )  has  the  constant  access  property.  Consider  X  6  C,  -  B.  A(X)  is  obviously  a 
subset  of  an  (s,  t)  UDC.  Again  using  the  result  of  Sigal  et.  al.  [1980],  we  know  A(X)  contains  at  most  one  arc 
from  each  (s,  t)  path.  We  need  to  show  that  this  number  is  exactly  one  for  (s,  t)  paths  in  r(X). 

Let  Y  e  B  and  consider  k  <  I  Y  | .  Let  i  =  max{j  <  k:  y;  e  d*(Y)},  thus  yi  is  the  last  element  of  d*(Y) 
accessed  at  stage  k.  Let  y  €  d  (Y)  with  tail(y)  =  headfy).  Because  {Y}  =  A,  and  by  the  definition  of  i,  y  e  A(Yj). 
Thus,  AQQ  contains  exactly  one  element  of  d  (Y). 

The  interval  property  on  (A,  Q  is  straightforward  to  show,  the  proof  is  provided  by  Korte'  and  Lovasz  [1984], 
who  called  all  greedoids  with  the  interval  property  "alternative  precedence  structures,"  or  APS  greedoids.  The  greedy 
algorithm  performed  on  (A,  £,  d  )  is  the  obvious  forward  sweep  algorithm,  see  Lawler  [1976]. 
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Example   12.     (Maximum   Flow  on   Planar  Directed  Graphs) 

Let  G  =  (N,  E)  be  a  directed  planar  graph  and  let  nodes  s  and  t  be  prespecified  source  and  sink  nodes.  We 
assume  that  for  each  u  e  N,  there  is  at  least  one  (u,  t)  path  in  G.  Let  v:E->9*+  be  a  function  giving  the  capacity 
values  for  each  of  the  arcs. 

Let  (CI,  C2,  ....  Ck)  be  the  set  of  UDCs  in  G.  The  maximum  (s,  t)  flow  MF  is  given  by 

MF  =  ^x€C1  v(x). 
The  constant  access  system  constructed  must  have  the  property  that  {d*(X),  X  e  £}  =  (Clf  C2,  ...,  Ck).   The 
development  of  the  greedy  constant  access  scheme  to  find  the  maximum  feasible  flow  in  G,  given  by  Itai  and 
Shiloach  [1979],  depends  on  the  existence  of  the  topmost  path  TP(E')  in  the  subgraph  G'  =  (N,  E')  for  any  subset  E' 
C  E  such  that  an  (s,  t)  path  in  G'.  The  algorithm  is  given  as  follows: 

initialize: 

Xo  =  0 

MXo)  =  0 

for  each  x  e  E,  r(x)  =  v(x) 

i  =  0 
While  TP(E  -  X0  #  0 

xM  =  argmirixeTP(E-X)  v(x) 

w(XM)  =  MXt)  +  r(xM) 
for  each  x  €  TP(E  -  Xi) 

r(x)  =  r(x)  -  r(xi+l) 
i  =  i  +  l 
endwhile 

Let  C,  be  the  set  of  strings  which  this  algorithm  might  generate  for  all  possible  choices  of  nonnegative  capacity 
functions  v,  and  let  B  be  the  set  of  basic  elements.  Let  Yn  e  B.  There  is  no  topmost  path  in  G'  =  (N,  E  -  Yn),  but 
yn  e  TP(E  -  Y^).  Thus  Yn  must  contain  an  (s,  t)  UDC,  and  this  UDC  must  contain  yn.  Chaining  backwards,  we 
are  able  to  identify  the  UDC  d*(Yn)  by  lemma  1. 

This  algorithm,  known  as  the  path  filling  algorithm,  is  shown  to  produce  the  maximum  flow  w(YG)  =  MF  in 
Itai  and  Shiloach.  (A(X):  X  e  Q  is  the  set  of  topmost  paths  in  G.  The  constant  access  property  holds  as  a  result 
I  Qn  Pj  |  =  1  for  each  path  Pj  in  the  set  {P,,  P2, ...,  Pm}  of  (s,  t)  paths. 


23 


Let  us  verify  the  interval  property  for  (E,  Q.  For  each  x  e  E  we  know  that  once  x  e  A(X),  x  is  on  the  current 
topmost  path,  and  will  remain  in  the  set  of  accessible  arcs  until  either  x  is  accessed  or  the  topmost  path  no  longer 
includes  x.  Let  k  be  the  smallest  index  such  that  x  g  A(Xk).  This  implies  that  Xk  contains  at  least  one  arc  of  every 
(s,  t)  path  which  involves  x.  In  stage  n,  n>k,  x  cannot  be  on  the  topmost  path  of  (N,  E  -  Xn)  because  Xk  c  Xn. 
Thus,  (E,  Q  has  the  interval  property.  Recapping,  the  system  (E,  £,  d  )  has  the  interval  and  constant  access 
properties,  is  a  greedy  system,  and  {d  (Y):  Ye  B)  is  a  clutter  on  E.  Hence  (E,  £,  d  )  is  a  constant  access  system. 

Let  us  consider  the  case  where  the  capacities  on  the  arcs  are  a  set  of  independent,  exponentially  distributed 
random  variables.  The  full  process  on  the  state  space  C,  will  give  us  the  absorption  time  distributions  F(Y,  t)  = 
P[X(t)  =  Y]  =  P[YG  =  Y,  w(Y)  <  t],  for  each  Y  6  B.  By  lumping  the  members  of  Y  by  their  determining 
structures,  we  may  find  F(Q,  t),  the  probability  that  C:  is  the  minimum  capacity  UDC  in  G  and  its  capacity  is  less 
than  or  equal  to  L  This  may  be  accomplished  by  lumping  strings  with  the  same  accessible  sets,  reducing  the  state 
space  size  to  the  number  of  (s,  t)  paths. 

The  probability  that  the  capacity  of  a  given  arc  constrains  the  maximum  flow  of  the  network,  the  criticality  of 
the  arc,  is  seen  to  depend  on  the  flow  value.  If  we  wish  to  find  the  criticality  of  a  set  of  arcs  K,  we  suggest  a 
lumping  of  the  basic  states  into  two  sets.  One  set  contains  all  basic  states  for  which  at  least  one  member  of  K  is  a 
member  of  the  determining  structure,  and  is  lumped  into  the  single  state  *Ft.  The  other  set  contains  the  complement 
of  the  first  and  is  labeled  ^j.  The  lumping  procedure  should  then  be  executed  on  the  remaining  state  space,  as 
suggested  in  Section  4.3. 

If  one  were  interested  in  reducing  the  capacity  of  the  network  to  to  or  less  by  interdicting  arcs  in  the  set  K,  one 
would  be  interested  in  1  -  P[X(to)  =  v?1]  =  P[K  contains  at  least  one  critical  arc  and  flow  is  greater  than  tj  as  a 
measure  of  the  importance  of  the  set  K  at  the  flow  value  1$.  Similarly,  we  can  construct  the  embedded  Markov  chain 
as  given  in  Section  4.4  to  give  the  probability  that  a  string  is  a  minimum  weight  string,  the  probability  that  a  UDC 
is  the  minimum  capacity  UDC,  and  the  probability  that  a  set  of  arcs  K  contains  critical  arcs. 

Example   13.      (K-trigger   Networks) 

Consider  a  directed  acyclic  network  G  =  (N,  E)  with  arc  length  function  v:E  — >  SK+.  In  this  problem 
formulation,  it  is  intuitive  to  regard  the  arcs  of  E  as  activities  as  in  PERT  formulations.  Suppose  that  each  node  n 
€  N  has  a  requirement  constant  kn  so  that  activities  emanating  from  n  cannot  commence  until  kn  activities  pointing 

into  n  have  completed.   Suppose  we  are  given  prespecified  nodes  s  and  L   Assume  that  indegree(s)  =  0.  We  are 
interested  in  the  time  of  completion  of  the  k^  arc  in  IN(t)  to  complete. 
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For  the  PERT  formulation,  k,,  =  indegree(n)  for  each  n  e  N,  no  activity  in  OUT(n)  can  start  until  all  activities 
in  IN(n)  are  complete.  Thus,  the  time  when  the  last  arc  completes  is  the  length  of  the  longest  path  in  G.  If  kr  =  1 
for  all  n  e  N,  the  time  of  completion  of  the  first  arc  in  IN(t)  is  the  length  of  the  shortest  path  in  G.  Thus,  This 
problem  which  we  name  the  k-trigger  network  problem  generalizes  both  shortest  and  longest  path  problems  on 
directed  graphs. 

The  k-trigger  network  model  is  also  useful  in  modelling  the  assembly  of  information  products  such  as  tracking 
information  assembled  by  an  air  control  system.  Each  of  the  activities  represents  some  data  collection  task  or  some 
ambiguity  resolution  activity.  Each  activity  must  have  several  independent  inputs  which  it  uses  to  produce  a 
coherent  product  or  conduct  some  data  collection  requiring  an  initial  solution.  These  activities  may  also  represent 
the  command  task,  giving  permission  for  subsequent  activities  to  begin. 

We  may  find  the  completion  time  of  the  kj"1  activity  in  IN(t)  by  the  following  greedy  algorithm 
initialize: 
Xo  =  0 
w(Xo)  =  0 

for  allx  €  E,  r(x)  =  v(x) 
A(X0)  =  OUT(s) 

i  =  0 

While  lxt  u  IN(t)  I  <  kt 

xM  =  argminxeA(Xi)  r(x) 

MXl+1)  =  w(Xt)  +  r(xM) 
for  all  x  €  A(X{) 

r(x)  =  r(x)  -  r(xul) 
if  IXM  ulN{head(x-))  I  =  khead(Xi)  then 

A(XM)  =  A(Xt)  -  IN(head(xt))  u  0U7(head(x))  -{xe  E:  no  (tail(x),  t)  path  exists  in 
(N,  E  -  XM)  u  OUT(head(xiJ)} 

else 

A(Xl+J)  =  A(Xt)  -  {xl+1J  -{xe  E:  no  (tail(x),  t)  path  exists  in  (N,  E-X„,)  u 

OUT(head(xl+1))} 
i  =  i  +  l 
endwhile 
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Let  £  be  the  set  of  strings  generated  over  all  length  functions  v  and  let  B  be  the  set  of  basic  strings.  Clearly,  if 
this  algorithm  generates  the  basic  string  Yn,  we  know  that  yn  is  the  k/h  arc  in  IN(t)  to  complete,  thus  clearly  yn  e 
d  (Yn).  Furthermore,  recall  that  j(yn)  is  the  minimum  j  such  that  yn  e  A(Yp.  From  the  algorithm,  we  see  that 
head(yj(vj)  =  tail(yn),  and  yj(y  j  is  the  k^,^  arc  to  be  accessed  in  IN(tail(yn)).  Hence,  it  must  be  on  the  longest  path 

from  s  to  tail(yn)  in  the  subgraph  (N,  Yn).  Thus,  we  can  chain  backwards  to  identify  d  (Yn)  as  the  longest  (s,  t)  path 
in  the  subgraph  (N,  Yn).  The  length  of  this  path  is  the  shortest  completion  time  of  the  assembly  process. 

Because  d  (Yn)  is  always  an  (s,  t)  path,  we  have  that  {d  (Y):  Ye  B)  is  a  clutter  on  E.  The  interval  property 
holds  because  an  arc  x  becomes  accessible  when  k^^)  arcs  in  IN(tail(x))  have  been  accessed  and  remains  accessible 
until  it  is  accessed  or  until  khcad(x)  arcs  in  IN(head(x))  are  accessed.  In  the  latter  event,  x  remains  inaccessible 
thereafter. 

The  constant  access  property  is  more  difficult  to  verify.  One  must  recognize  that  given  that  ^  is  generated  by 
the  above  algorithm,  ACX^  is  a  partial  UDC.  One  must  show  that  any  (s,  t)  path  Pj  for  which  |  AQiJ  n  Pj  |  =0 
is  dominated  in  length  by  at  least  one  path  P2  for  which  |  A(X)  n  P2 1  =1.  Pj  will  never  be  the  longest  (s,  t)  path 
in  (N,  Y)  for  any  Y  3  Xi,  Y  e  B.  Hence,  P:  g  r(X;).  Thus,  the  constant  access  property  holds  for  this  system. 
The  system  has  the  three  properties  necessary  for  it  to  be  a  constant  access  system. 

We  can  determine  the  probability  that  a  given  arc  is  critical,  a  member  of  d  (YG),  by  using  the  embedded 
Markov  chain.  We  can  derive  interesting  performance  measures  such  as  the  distribution  of  the  total  time  of 
assembly,  the  probability  that  a  given  arc  is  critical  given  the  assembly  time  is  less  than  l$,  and  the  probability  that 
a  set  of  arcs  contains  a  critical  arc  given  that  the  assembly  time  exceeds  t^  by  using  the  lumping  procedure  to  alter 
the  matrix  Q. 

5.2      Systems   with    Bottleneck    Objective    Functions 

In  this  section,  we  discuss  three  constant  access  systems  which  use  the  bottleneck  objective  function.  The 
bottleneck  objective  function,  first  specified  by  Edmonds  and  Fulkerson  [1970],  is  used  to  find  the  structure  with  the 
lowest  cost  where  the  cost  of  a  structure  is  the  weight  of  the  maximum  weight  element  in  the  structure.  In  this 
section,  we  present  examples  where  the  structures  are  cutsets,  paths  and  trees.  These  are  given  in  network  reliability, 
bottleneck  shortest  path,  and  botdeneck  minimum  weight  tree. 

Example    14.      (Network   Reliability) 

Consider  a  network  G  =  (N,  E)  with  undirected  arcs  whose  usability  is  perishable.  For  instance,  consider  a 
communications  network  with  links  which  fail  with  time.   The  network  contains  a  set  S  of  sender  nodes  and  a 
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disjoint  set  T  of  terminals.  We  are  interested  in  the  time  it  takes  for  the  network  to  fail  to  the  point  where  there  is 
no  path  of  usable  arcs  from  some  member  of  S  to  some  member  of  T,  that  is,  the  time  that  S  and  T  are  no  longer 
completely  connected.  Note  that  this  problem  has  (s,  t)  and  (s,  K)  reliability  as  special  cases. 

Let  {Cj,  C2, ...,  Ck}  =  C  be  the  set  of  (S,  T)  cutsets,  and  let  v:E  ->  9S+  be  a  function  giving  the  lifelength  of 
each  arc.  The  quantity  of  interest  is  the  time  of  failure  TF  of  the  longest  lived  arc  in  the  shortest  lived  cutset, 

TF  =  minCv€C  max^^  v(x). 

TF  is  a  well-known  instance  of  the  bottleneck  objective  function  on  the  set  C.  The  obvious  algorithm  for  finding 
TF  is  given  as 

initialize: 

Xo  =  0 

w(Xo)  =  0 

for  all  x  e  E,  r(x)  =  v(x) 

i  =  0 
While  S  and  T  are  completely  connected  in  (N,  E  -  Xzj 

xl+l  =  argminxeE_Xi  r(x) 

w(XM)  =  w(X,)  +  r(xi+l) 
for  all  x  e  E  -XL 

r(x)  =  fix)  -  r(xi+j) 
i  =  i  +  l 
endwhile 

At  each  stage,  w(Xx)  =  v(x1),  thus  if  the  algorithm  terminates  in  n  steps,  xn  is  the  longest  lived  arc  in  the 
shortest  lived  cutset,  and  w(Xn)  =  v(xn)  is  the  time  of  disconnection.  Let  £  be  the  set  of  strings  generated  by  this 
algorithm  over  all  nonnegative  failure  time  functions. 

The  system  (E,  £,  d  )  has  determining  structures  which  are  singleton  sets,  d  (X)  =  {xj.  Thus  {d  (Y):  Y  e  B) 
=  E,  thus  {d  (Y):  Ye  B}  is  a  clutter  on  the  set  E.  For  each  X^  e  £, 

T(X)  =  (d*(Y):  X,  C  Y}  =  E  -  \  =  A(X), 
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thus  the  constant  access  property  is  satisfied,  |  d  (Yn)  u  A(X;)  |  =  |  yn  |  =  1  for  each  Yn  such  that  X;  C  Yn.  The 
interval  property  holds  because  every  arc  is  accessible  until  it  is  accessed  or  the  algorithm  terminates.  Thus,  (E,  (,, 

d  )  is  a  constant  access  system. 

Clearly,  the  network  reliability  problem  for  the  case  where  the  lifelengths  are  independent  exponentials  is 
solvable  using  Markov  processes.  By  appropriate  lumping  of  basic  elements,  we  may  determine  for  each  time  of 
failure  the  probability  that  a  given  cutset  is  longest  lived  and  the  probability  that  a  given  arc  is  the  arc  which 
determines  the  lifelength  of  the  system.  The  embedded  Markov  chain  may  be  used  to  find  these  quantities  without 
regard  for  failure  time. 

Example   15.      (Bottleneck   Shortest   Path) 

We  now  turn  attention  to  a  system  which  finds  the  minimum  weight  path  where  path  weights  are  given  by  the 
longest  arc  in  the  path.  Let  {Pj,  P2, ...,  Pn}  =  P  be  the  set  of  (s,  t)  paths  in  G.  The  bottleneck  (s,  t)  path  problem 
may  be  stated  as:  find  the  (s,  t)  path  with  the  shortest  longest  arc.  That  is,  find  Pi  which  minimizes 

BP  =  minp  eP  maxxeP.  v(x). 

The  following  greedy  algorithm  finds  the  minimizing  path  and  the  optimal  value  BP. 

initialize: 
Xo  =  0 

MXo)  =  0 

for  all  x  e  E,  r(x)  =  v(x) 
i  =  0 
While  Xj  does  not  contain  an  (s,  t)  path 
xul  =  argminxeE_x.  r(x) 

*i+;  =  %i '  xi+i 
MXl+1)  =  w(Xi)  +  r(xM) 
for  all  x  e  E  -  Xj 

r(x)  =  r(x)-r(xi+j) 
i  =  i  +  l 
endwhile. 

BP  is  given  by  w(YG).  Let  C  be  the  set  of  all  strings  generated  by  this  algorithm.  As  with  the  reliability 
problem,  the  interval  property  holds  because  each  arc  is  accessible  at  each  stage  prior  to  termination.  The 
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determining  structure  of  each  Ym  e  B  is  yn,  and  A(X;)  =  E  -  X,  for  all  nonbasic  Xr    Hence  the  constant  access 
property  must  hold.  Obviously  {d  (Y):  Ye  B)  =  E,  a  clutter  on  itself. 

Thus,  (E,  £,  d  )  is  a  constant  access  system.  The  methodology  in  sections  4.3  through  4.5  may  be  used  to 
find  the  distribution  of  BP,  the  moments  of  BP,  and  the  probability  that  a  given  arc  is  the  arc  determining  BP.  Note 
that  the  minimizing  path  is  not  unique,  and  every  (s,  t)  path  in  (N,  X)  is  equally  qualified  to  be  the  minimum 
weight  path. 

Example   16.      (Bottleneck   Spanning   Tree) 

Let  (Tj,  T2 Tn)  be  the  set  of  arc  sets  of  spanning  trees  in  the  undirected  network  G  =  (N,  E).    The 

bottleneck  spanning  tree  problem,  very  similar  to  the  bottleneck  path  problem,  is  to  find  the  spanning  tree  with  the 
shortest  longest  arc, 

BST  =  minj€  j  maxx6  j-  v(x). 

The  greedy  algorithm  to  solve  the  bottleneck  spanning  tree  problem  is  identical  to  the  bottleneck  path  problem, 
except  that  we  terminate  the  algorithm  when  Xi  contains  a  spanning  tree.  The  determining  structures  are  singleton 
arc  sets,  and  the  interval  and  constant  access  properties  hold.  Hence,  the  system  (E,  £,  d  )  is  a  constant  access 
system. 

6.0    CONCLUSION 

In  this  work,  we  have  constructed  a  new  structural  framework  for  randomly  weighted  network  optimization 
called  a  constant  access  system.  If  a  structure  has  the  properties  we  have  given  here,  we  may  find  the  joint 
distribution  of  the  minimum  weight  basis  element  and  its  weight  by  calculating  the  absorption  time  distribution  of  a 
Markov  process.  We  provide  the  construction  of  this  Markov  process,  and  demonstrate  expansively  how  we  may 
exploit  the  structure  of  the  Markov  process  to  derive  measures  of  stochastic  performance  for  the  general  problem. 

We  have  established  that  the  mechanism  of  transition  in  a  Markov  process  is  to  greedily  minimize  the  sojourn 
time  in  every  state.  This  fortunate  property  allowed  us  to  model  the  execution  path  of  the  greedy  algorithm  as  the 
sample  path  in  a  Markov  process. 
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APPENDIX    A. 

In  this  appendix  we  present  the  proof  to  lemma  2. 
Lemma  2.  Let  (E,  £,  d  )  be  a  greedy  constant  access  system.   Let  X  be  a  greedily  generated  string,  |  X  |  =  n. 
Then  for  each  x  e  A(X),  x  e  d  (Xx).  " 

Proof.  For  each  i,  define  the  following  two  subsets  of  T(Y  •  y).  Let  D  =  {J  e  T(Y  •  y)  such  that 

Ez6JnX-x   V(Z>  =   maxJ€r(Xx)  S*eirX-x    v(z) 

Thus,  d*(X  •  x)  =  J  n  X  •  x  for  any  J  e  D.  Let  K  =  {J  e  T(X  •  x):  x  e  J}.  Let  Dk  =  {J  e  T(Xk)  such  that 

£ze™k  v(z>  =  m^jerxxk)  Sz6JnXk   V<Z) 

Thus,  d*(Xk)  =  J  n  Xk  for  any  J  e  Dk.  Let  Kk  =  {J  e  T(Xk):  x  e  J)     We  will  show  that  if  Kk  C  Dk  for  k  =  0, 

1, ...,  i,  then  K  C  D.  This  will  prove  the  lemma  by  induction. 

Let  i  =  0.  In  this  case  the  proposition  holds  trivially  since  K  =  D  =  {d  (Z):  Z  e  B).  Thus,  suppose  that  for  k 
=  0,  1,  ...,  i,  Kk  C  Dk.   In  order  to  show  that  this  implies  that  K  C  D,  we  need  to  treat  two  cases:  j(x)  =  i,  and 

j(x)  <  i. 

Case  1:  j(x)  =  i,  thus  x  is  accessible  only  after  xj  has  been  accessed.  Let  K  €  K.  Then  lemma  1  gives  us  that  xj  e 

K  so  K  e  Kj.  Thus,  by  induction  hypothesis,  K  e  Dj.  We  must  show  that  K  e  D. 

Let  J  e  D.  Then 

^zGJnXx      v(z)     *  Sz€KnX-»      v(z)   +  v(xi+l) 

-    ^gm-,    v(z>-  (A-1) 

Thus,  K  €  D. 
Case  2:  j(x)  =  h  <  i.  Let  K  e  K.  Let  J  e  D  and  assume  that  K  g  D.  Thus 

Sz€K^x     V(Z>     <       ^eJnXx     V(Z)'  (A-2) 

The  constant  access  property  guarantees  that  x^  e  K,  and  the  induction  hypothesis  guarantees  that  Xj  e  Jj. 
Hence 

^zSKnX,.!     V(Z)  +  V(X)=     I,eKr0{.x     v(Z) 
<   ^GJrtXi+1     V(Z)     =     ^zSJnX^     V(Z)  +  V(Xi)  ,  (A.3) 
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the  inequality  resulting  from  equation  A.2.    Note  that    [xv  x)  C  A(Xj_j).    It  is  straightforward  to  show  that  if 
inequality  A.3  holds,  then  GCX^j)  *  xv  In  fact,  w(Xj_i  •  Xj)  >  w(Xj_i  •  x),  and  both  Xj  and  x  were  accessible  at 

stage  i  -  1.  This  shows  that  for  case  2,  if  we  assume  K  e  K  and  Kg  D,  we  can  derive  a  contradiction. 
Thus,  we  have  shown  for  both  cases  that  KCD.  The  lemma  follows  directly.     • 
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